Algorithmic problems for 
free-abelian times free groups 

Jordi Delgado* & Enric Venturat 

January 14, 2013 

Keywords: free group, free-abelian group, decision problem, automorphism. 
MSG: 20E05, 20K01. 

Abstract 

We study direct products of free-abelian and free groups with special 
emphasis on algorithmic problems. After giving natural extensions of 
standard notions into that family, we find an explicit expression for an 
arbitrary endomorphism of Z'" x Fn- These tools are used to solve several 
algorithmic and decision problems for x _F„: the membership problem, 
the isomorphism problem, the finite index problem, the subgroup and 
coset intersection problems, the fixed point problem, and the Whitehead 
problem. 
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Introduction 



Free-abelian groups, namely Z™, are classical and very well known. Free groups, 
namely F„, are much wilder and have a much more complicated structure, but 
they have also been extensively studied in the literature since more than a 
hundred years ago. The goal of this paper is to investigate direct products of 
the form Z™ x Fn, namely free-abelian times free groups. At a first look, it 
may seem that many questions and problems concerning Z™ x Fn will easily 
reduce to the corresponding questions or problems for Z™ and i^„; and, in fact, 
this is the case when the problem considered is easy or rigid enough. However, 
some other naive looking questions have a considerably more elaborated answer 
in Z™ X Fn rather than in Z"* or Fn- This is the case, for example, when one 
considers automorphisms: Aut(Z'" x Fn) naturally contains GLmiZ) x Aut(F„), 
but there are many more automorphisms other than those preserving the factors 
Z™ and Fn- This fact causes potential complications when studying problems 
involving automorphisms: apart from understanding the problem in both the 
free-abelian and the free parts, one has to be able to control how is it affected 
by the interaction between the two parts. 

Another example of this phenomena is the study of intersections of subgroups. 
It is well known that every subgroup of Z™ is finitely generated. This is not true 
for free groups F„ with n ^ 2, but it is also a classical result that all these groups 
satisfy the Howson property: the intersection of two finitely generated subgroups 
is again finitely generated. This elementary property fails dramatically in Z™ xi<"„, 
when m > 1 and 2 (a very easy example reproduced below, already appears 
in [ ] attributed to Moldavanski) . Consequently, the algorithmic problem of 
computing intersections of finitely generated subgroups of Z™ x Fn (including the 
preliminary decision problem on whether such intersection is finitely generated 
or not) becomes considerably more involved than the corresponding problems 
in Z™ (just consisting on a system of linear equations over the integers) or in 
Fn (solved by using the pull-back technique for graphs). This is one of the 
algorithmic problems addressed below (see Section 4). 

Along all the paper we shall use the following notation and conventions. For 
n ^ 1, [n] denotes the set integers {1, . . . ,n}. Vectors from Z™ will always be 
understood as row vectors, and matrices M will always be though as linear 
maps acting on the right, v i-^ vM; accordingly, morphisms will always act on 
the right of the arguments, x i-^ xa. For notational coherence, we shall use 
uppercase boldface letters for matrices, and lowercase boldface letters for vectors 
(moreover, if w € F„ then w e Z" will typically denote its abelianization) . We 
shall use lowercase Greek letters for endomorphisms of free groups, (j)-Fn Fn, 
and uppercase Greek letters for endomorphisms of free-abelian times free groups, 

^-.Z"" X Fn^Z"" X Fn. 

The paper is organized as follows. In Section 1, we introduce the family 
of groups we are interested in, and we import there several basic notions and 
properties shared by both families of free-abelian, and free groups, such as 
the concepts of rank and basis, as well as the closeness property by taking 
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subgroups. In Section 2 we remind the folklore solution to the three classical 
Dehn problems within our family of groups. In the next two sections we study 
some other more interesting algorithmic problems: the finite index subgroup 
problem in Section 3, and the subgroup and the coset intersection problems in 
Section 4. In Section 5 we give an explicit description of all automorphisms, 
monomorphisms and endomorphisms of free-abelian times free groups which we 
then use in Section 6 to study the fixed subgroup of an endomorphism, and in 
Section 7 to solve the Whitehead problem within our family of groups. 

1 Free-abelian times free groups 

Let T = {ti \ i e 1} and X = {xj \ j e J} be disjoint (possibly empty) sets of 
symbols, and consider the group G given by the presentation 

G={T,X\[T,TuX]), 

where [A, B] denotes the set of commutators of all elements from A with all 
elements from B. Calling Z and F the subgroups of G generated, respectively, 
by T and X, it is easy to see that Z is a free-abelian group with basis T, and F is 
a free group with basis X. We shall refer to the subgroups Z = (T) and F = {X) 
as the free-abelian and free parts of G, respectively. Now, it is straightforward 
to see that G is the direct product of its free-abelian and free parts, namely 

G={T,X\[T,TuX])-ZxF. (1.1) 

We say that a group is free-abelian times free if it is isomorphic to one of the 
form (1.1). 

It is clear that in every word on the generators T u X, the letters from T 
can freely move, say to the left, and so every element from G decomposes as a 
product of an element from Z and an element from F, in a unique way. After 
choosing a well ordering of the set T (whose existence is equivalent to the axiom 
of choice), we have a natural normal form for the elements in G, which we shall 
write as t^w, where a = {ai)i e ©j^/Z, stands for the (finite) product Ilig/t"' 
(in the given order for T), and w is a reduced free word on X. 

Observe that the center of the group G is Z unless F is infinite cyclic, in 
which case G is abelian and so its center is the whole G. This exception will 
create some technical problems later on. 

We shall mostly be interested in the finitely generated case, i.e. when T and 
X are both finite, say / = [m] and J = [n] respectively, with m, n ^ 0. In this 
case, Z is the free-abelian group of rank m, Z = Z™, F is the free group of rank 
n, F = Fn, and our group G becomes 

G — Z X Fji — ( i 1 , . . . , tjyi ^xi^...^Xji\titj — tji^^tiXfi; — Xf^t-i^^ ( 1 ■^) 

where i, j e [m] and k e [n]. The normal form for an element g e G is now 

g = t'^w = ^I'-'C" w{xi,. . .,Xn), 
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where a = (ai, . . . , e Z™ is a row integral vector, and w = w{xi, . . . , .t„) is a 
reduced free word on the alphabet X. Note that the symbol t by itself has no 
real meaning, but it allows us to convert the notation for the abelian group Z™ 
from additive into multiplicative, by moving up the vectors (i.e. the entries of 
the vectors) to the level of exponents; this will be especially convenient when 
working in G, a noncommutative group in general. 

Observe that the ranks of the free-abelian and free parts of G, namely m and 
n, are not invariants of the group G, since Z"* x Fi ^ Z"*"^^ x Fq. However, as 
one may expect, this is the only possible redundancy and so, we can generalize 
the concepts of rank and basis from the free-abelian and free contexts to the 
mixed free-abelian times free situation. 

Observation 1.1. Let Z and Z' be arbitrary free-abelian groups, and let F and 
F' be arbitrary free groups. If F and F' are not infinite cyclic, then 

ZxF-Z'xF' ^ Tk{Z) = rk(Z') and rk(F) = rk(i^')- 

Proof. It is straightforward to see that the center of ZxF is Z (here is where F i^Z 
is needed). On the other hand, the quotient by the center gives (Z x F)/Z ^ F. 
The result follows immediately. □ 

Definition 1.2. Let G = Z x F he a free-abelian times free group and assume, 
without loss of generality, that F fL. Then, according to the previous obser- 
vation, the pair of cardinals (k, ?), where k is the abelian rank of Z and <; is 
the rank of F, is an invariant of G, which we shall refer to as the rank of G, 
rk(G). (We allow this abuse of notation because the rank of G in the usual 
sense, namely the minimal cardinal of a set of generators, is precisely k + 
G is, in fact, generated by a set of k + ^ elements and, abelianizing, we get 
G'^^ = {Z X F)'^^ = Z ® F^^ , & free-abehan group of rank k + <r, so G cannot be 
generated by less than k + <; elements.) 

Definition 1.3. Let G = x F be a free-abelian times free group. A pair {A, B) 
of subsets of G is called a basis of G if the following three conditions are satisfied: 

(i) A is an abelian basis of the center of G, 

(ii) B is empty, or a free basis of a non-abelian free subgroup of G (note that 
this excludes the possibility |B| = 1), 

(iii) {AuB) = G. 

In this case we shall also say that A and B are, respectively, the free-abelian and 
free components of {A,B). From (i), (ii) and (iii) it follows immediately 

(iv) (A)n(B) = {l}, 

(v) AnB = 0, 

since (A) n (B) is contained in the center of G, but no non trivial element of (B) 
belongs to it. 
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Usually, we shall abuse notation and just say that AuB is a basis of G. Note 
that no information is lost because we can retrieve A as the elements m Au B 
which belong to the center of G, and B as the remaining elements. 

Observe that, by (i), (iii) and (iv) in the previous definition, if {A,B) is a 
basis of a free-abelian times free group G, then G = (A) x {B); and by (i) and (ii), 
{A) is a free-abelian group and {B) is a free group not isomorphic to Z; hence, 
by Observation 1.1, rk(G) = {\A\, \B\). In particular, this implies that {\A\, \B\) 
does not depend on the particular basis {A, B) chosen. 

On the other hand, the first obvious example \sT u X being a basis of the 
group G = (r,X I [T, T u X]) (note that if |X| + 1 then A = T and S = X, 
but if \X\ = 1 then A = T u X and B = due to the technical requirement in 
Observation 1.1). We have proved the following. 

Corollary 1.4. Every free-abelian times free group G has bases and, every basis 
iA,B) ofG satisfies rk(G) = {\A\, \B\). □ 

Let us focus now our attention to subgroups. It is very well known that every 
subgroup of a free-abelian group is free-abelian; and every subgroup of a free 
group is again free. These two facts lead, with a straightforward argument, to 
the same property for free-abelian times free groups (this will be crucial for the 
rest of the paper) . 

Proposition 1.5. The family of free-abelian times free groups is closed under 
taking subgroups. 

Proof. Let T and X be arbitrary disjoint sets, let G be the free-abelian times 
free group given by presentation (1.1), and let H ^G. 

If \X\ = 0, 1 then G is free-abelian, and so H is again free-abelian (with rank 
less than or equal to that of G); the result follows. 

Assume \X\ ^ 2. Let Z = (T) and F = {X) be the free-abelian and free parts 
of G, respectively, and let us consider the natural short exact sequence associated 
to the direct product structure of G: 

l^Z^ZxF = G^F^l, 

where t is the inclusion, tt is the projection f^w i-^ w, and therefore ker(7r) = Z = 
Im((,). Restricting this short exact sequence to H ^ G, we get 

1 ker(7r|H) H ^ Hn ^ I, 

where 1 ^ ker(7r|/f) = H n ker(7r) = H n Z Z, and 1 ^ iJyr ^ F. Therefore, 
ker(7r|^) is a free-abelian group, and Htt is a free group. Since Hn is free, ir^ff 
has a splitting 

H^Htt, (1.3) 
sending back each element of a chosen free basis for Hit to an arbitrary preimage. 
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Hence, a is injective, Hira ^ H is isomorphic to Hi:, and straightforward 
calculations show that the following map is an isomorphism: 

Qa-H — > kcr(7r|^) X i/TTo; 
h I — > (^h{hna)^^ , ft.7ra). 

Thus H ~ ker(7r|^) x Hna is free-abelian times free and the result is proven. □ 

This proof shows a particular way of decomposing H into a direct product 
of a free-abelian subgroup and a free subgroup, which depends on the chosen 
splitting a, namely 

H = {H n Z) X Hna. (1.5) 

We call the subgroups H n Z and HTra, respectively, the free-abelian and free 
parts of H , with respect to the splitting a. Note that the free-abelian and free 
parts of the subgroup H = G with respect to the natural inclusion G ^ F:a 
coincide with what we called the free-abelian and free parts of G. 

Furthermore, Proposition 1.5 and the decomposition (1.5) give a characteriza- 
tion of the bases, rank, and all possible isomorphism classes of such an arbitrary 
subgroup H. 

Corollary 1.6. With the above notation, a subset EQH^G=ZxFisa basis 
of H if and only if 

E = Ez Li Ep , 

where Ez is an abelian basis of H n Z , and Ep is a free basis of Hna, for a 
certain splitting a as in (1.3). 

Proof. The implication to the left is straightforward, with E = AuB, and {A, B) = 
(Ez,Ef) except for the case rk(F) = 1, when we have (A, B) = {Ez u Ef,0). 

Suppose now that E = Au B is a. basis of H in the sense of Definition 1.3, 
and let us look at the decomposition (1.5), for suitable a. If rk(iJ7r) = 1, then 
H is abelian, A is an abelian basis for H, B = and all but exactly one of the 
elements in A belong to H n Z (i.e. have normal forms using only letters from 
T); in this case the result is clear, taking Ep to be just that special element. 
Otherwise, Z{H) = HnZ having A as an abelian basis; take Ez = A and Ep = B. 
It is clear that the projection tt: -»• Hn, t^u i-^ u, restricts to an isomorphism 
n\i^B)'-{B) -* Hit since no nontrivial element in (B) belong to kerTr = H n Z. 
Therefore, taking a = T^lj^y Ep is a free basis of Hna. □ 

Corollary 1.7. Let G be the free-abelian times free group given by presenta- 
tion (1.1), and let rk(G) = (k, <j). Every subgroup H ^ G is again free-abelian 
times free with rk(i7) = (k', where, 

(i) in case of = 0: ^ k' ^ k and = 0; 

(ii) in case of q ^ 2: either ^ k' ^ k + 1 and <r' = 0, or ^ k' ^ k and 
^ ^' ^ max{<;, Kq} and q' + 1. 
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Furthermore, for every such (k' , <;'), there is a subgroup H ^ G such that 
rk(i?) = («',<;'). □ 



Along the rest of the paper, we shaU concentrate on the finitely generated 
case. From Proposition 1.5 we can easily deduce the following corollary, which 
will be useful later. 

Corollary 1.8. A subgroup H of 17^ x is finitely generated if and only if its 
projection to the free part Hn is finitely generated. □ 

The proof of Proposition 1.5, at least in the finitely generated case, is 
completely algorithmic; i.e. if H is given by a finite set of generators, one can 
effectively choose a splitting a, and compute a basis of the free-abelian and free 
parts of H (w.r.t. a). This will be crucial for the rest of the paper, and we make 
it more precise in the following proposition. 

Proposition 1.9. Let G = Z™ x Fn be a finitely generated free-abelian times free 
group. There is an algorithm which, given a subgroup H ^ G by a finite family 
of generators, it computes a basis for H and writes both, the new elements in 
terms of the old generators, and the old generators in terms of the new basis. 

Proof. If n = |X| = 0, 1 then G is free-abelian and the problem is a straightforward 
exercise in linear algebra. So, let us assume 2. 

We are given a finite set of generators for H, say f^^wi, . . . ,t'^''Wp, where 
p ^ 1, Ci, . . . , Cp 6 Z™ are row vectors, and wi, . . . ,Wp € Fn are reduced words 
on X = {xi, . . . ,Xn}. Applying suitable Nielsen transformations, see [IS], we 
can algorithmically transform the p-tuple {wi, . . . ,Wp) of elements from 
into another of the form (ui, . . . , 1, . . . , 1), where is a free 

basis of {wi, . . . ,Wp) = Ht:, and ^ n' ^ p. Furthermore, reading along the 
Nielsen process performed, we can effectively compute expressions of the new 
elements as words on the old generators, say Uj = r]j{wi, . . . ,Wp), j e [n'], as 
well as expressions of the old generators in terms of the new free basis, say 

= Vi{ui,. . . ,u„')j for * s [p]. 

Now, the map a'-Hn ->■ H, Uj i-> rjj{t^'^wi, . . . jt^^Wp) can serve as a splitting 
in the proof of Proposition 1.5, since r]j{t'^^wi,. . . jf^^Wp) = t'^'r]j{wi, . . . ,Wp) = 
f^^Uj 6 H, where aj, j e [n'], are integral linear combinations of Ci, . . . , Cp. 

It only remains to compute an abelian basis for ker(7r|/j) = _ff nZ™. For 
each one of the given generators h = f^'Wi, compute h{hTTa)^^ = f*' (here, we 
shall need the words Vi computed before). Using the isomorphism Qa from the 
proof of Proposition 1.5, we deduce that {t'*'^, . . . ,t'*p} generate 77 nZ™; it only 
remains to use a standard linear algebra procedure, to extract from here an 
abelian basis {t^^ t^"^' } for iJ n Z™. Clearly, ^ m' ^ m. 

We immediately get a basis {A, B) for H (with just a small technical caution): 
if n' # 1, take A = {t*'!, . . . ,t'^"''} and B = {f^iui, . . . , f^-'-Un-}; and if n' = 1 take 
A= {t^\...,t^'"',t'^^ui} andB = 0. 
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On the other hand, as a side product of the computations done, we have 
the expressions t^^uj = r]j{t'^^wi, . . . jf^^Wp), j e [n']. And we can also compute 
expressions of the t*'''s in terms of the ^^''s, and of the f^'^s in terms of the 
f^'Wj's. Hence we can compute expressions for each one of the new elements in 
terms of the old generators. 

For the other direction, we also have the expressions Wi = . . . 

for i 6 [p]. Hence, (f^^ ui , . . . , f*"' u„' ) = t^'Wi for some ei e Z™. But H b 
{t'^^Wi){t^''Wiy^ = t'^'"''' € Z™, so we can compute integers Ai, . . . , A,„' such that 
Ci - e; = Aibi + - + X,n'hm'- Thus, f'-'Wi = t'^'-'"t'='w, = t^i'"i+-+^"''^-'t'''w;i = 
(tbi)^i...(tt'".')^-''^.(t"^"i,---,t""'M„0, for ze [p]. □ 

As a first application of Proposition 1.9, free-abelian times free groups have 
solvable membership problem. Let us state it for an arbitrary group G. 

Problem 1.10 (Membership Problem, MP(G)). Given elements g, hi, . .. ,hp e 

G, decide whether g € H = {hi, . . . , hp) and, in this case, computes an expression 
of g as a word on the hi 's. 

Proposition 1.11. The Membership Problem for G = Z™ x F„ is solvable. 

Proof. Write g = t^w. We start by computing a basis for H following Propo- 
sition 1.9, say {t^^ , ■ . . ,t*''"', t^^ui, . . . ,t'*"'u„'}. Now, check whether g-K = w € 
Htt = {ui, . . . , Un') (membership is well known for free groups). If the answer 
is negative then g ^ H and we are done. Otherwise, a standard algorithm for 
membership in free groups gives us the (unique) expression of u; as a word on the 
Uj's, say w = . . . , u„'). Finally, compute uj{t^^ui, . . . , f^^'Un') = t^w € H. 

It is clear that f^w € H ii and only if t'^"^ = (t'*M;)(t'^w)"^ e H that is, if and only 
if a - c 6 (bi, . . . , bm') ^ Z"*. This can be checked by just solving a system of 
linear equations; and, in the affirmative case, we can easily find an expression for 
g in terms of {t''^ , . . . , t''™' , t^'^ui, . . . , ^^"'Un'}, like at the end of the previous 
proof. Finally, it only remains to convert this into an expression of g in terms 
of {hi, . . . , hp} using the expressions we already have for the basis elements in 
terms of the /i^'s. □ 

Corollary 1.12. The membership problem for arbitrary free-abelian times free 
groups is solvable. 

Proof. We have G = Z x F, where Z = (T) is an arbitrary free-abelian group 
and F = {X) is an arbitrary free group. Given elements g, hi, . . . ,hp e G, let 
{ti,. . . , t„i} (resp. {xi, . . . , Xn}) be the finite set of letters in T (resp. in X) used 
by them. Obviously all these elements, as well as the subgroup H = {hi,. . . , hp), 
live inside {ti,. . . ,tm) x {xi,. . . ,Xn) - x Fn and we can restrict our attention 
to this finitely generated environment. Proposition 1.11 completes the proof. □ 
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To conclude this section, let us introduce some notation that will be useful 
later. Let H he a. finitely generated subgroup of G = x F„, and consider a 
basis for H, 

{t''\...,t''«",t^^«i,...,t«'>'w„'}, (1.6) 

where ^ m' ^ to, {bi, . . . , h^^'} is an abelian basis of n ^ Z™, ^ n', 
ai,...,an' e Z™, and {ui, . . . ,Un'} is a free basis of Hn < F„. Let L = 
(bi, . . . ,bin'} ^ Z™ (with additive notation, i.e. these are true vectors with 
TO integral coordinates each), and let us denote by A the n' x m integral matrix 
whose rows are the ai's, 

A = | : j e A^„'><„(Z). 

If is a word on n' letters (i.e. an element of the abstract free group Fn'), we 
will denote by w(ui, . . . ,w„') the element of Htt obtained by replacing the z-th 
letter in w by Ui, i 6 [n']. And we shall use boldface, w, to denote the abstract 
abelianization of co, which is an integral vector with n' coordinates, u> e Z" (not 
to be confused with the image of cj(iii, . . . ,m„') e Fn under the abelianization 
map Fn ^ Z"). Straightforward calculations provide the following result. 

Lemma 1.13. With the previous notations, we have 

H = {t^u){ui, ...,Un') I w e F„',a e a>A + L}, 
a convenient description of H. □ 

Definition 1.14. Given a subgroup H ^ Z™ x F„, and an element w e Fn, we 
define the abelian completion of w in H as 

C^,H = {aeZ'"|i"«;€H}cZ™. 

Corollary 1.15. With the above notation, for every w & Fn we have 

(i) ifw^ Hit, then Cw,h = 0; 

(ii) if w & Hw, then Cw,h = wA + L, where (jj is the abelianization of the 

word Lo which expresses w e Fn in terms of the free basis {ui, . . . ,Un'} (i-C. 
w = Lo{ui, . . . , Un'); note the difference between w and to). 

Hence, Cw,h £ Z™ is either empty or an affine variety with direction L (i.e. a 
coset of L). □ 



2 The three Dehn problems 

We shall dedicate the following sections to solve several algorithmic problems in 
G = Z"* X Fn- The general scheme will be reducing the problem to the analogous 
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problem on each part, Z"* and F„, and then apply the vast existing literature 
for free-abelian and free groups. In some cases, the solutions for the free-abelian 
and free parts will naturally build up a solution for G, while in some others the 
interaction between both will be more intricate and sophisticated; everything 
depends on how complicated becomes the relation between the free-abelian and 
free parts, with respect to the problem. 

From the algorithmic point of view, the statement "let G be a group" is 
not sufficiently precise. The algorithmic behavior of G may depend on how it 
is given to us. For free-abelian times free groups, we will always assume that 
they are finitely generated and given to us with the standard presentation (1.2). 
We will also assume that the elements, subgroups, homomorphisms and other 
objects associated with the group are given to us in terms of this presentation. 

As a first application of the existence and computability of bases for finitely 
generated subgroups of G, we already solved the membership problem (see 
Corollary 1.12), which includes the word problem. This last one, together 
with the conjugacy problem, are quite elementary because of the existence of 
algorithmically computable normal forms for the elements in G. The third of 
Dehn's problems is also easy within our family of groups. 

Proposition 2.1. Let G = Z" x F„. Then 

(i) the word problem for G is solvable, 

(ii) the conjugacy problem for G is solvable, 

(iii) the isomorphism problem is solvable within the family of finitely generated 
free-abelian times free groups. 

Proof. As seen above, every element from G has a normal form, easily computable 
from an arbitrary expression in terms of the generators. Once in normal form, 
f^u equals 1 if and only if a = and u is the empty word. And f^u is conjugate 
to t^v if and only if a = b and u and v are conjugate in f„. This solves the 
word and conjugacy problems in G. 

For the isomorphism problem, let {X \ R) and (y | 5) be two arbitrary 
finite presentations of free-abelian times free groups G and G' (i.e. we are given 
two arbitrary finite presentations plus the information that both groups are 
free-abelian times free). So, both G and G' admit presentations of the form (1.2), 
say 'Pn,m and Vn'.m', for some integers m, n, m', n' ^ 0, n,n' i= I (unknown at the 
beginning) . It is well known that two finite presentations present the same group 
if and only if they are connected by a finite sequence of Tietze transformations 
(see [1^]); so, there exist finite sequences of Tietze transformations, one from 
{X I i?) to Vn,rm ^ud another from (y | S') to Vn'.m' (again, unknown at the 
beginning). Let us start two diagonal procedures exploring, respectively, the 
tree of all possible Tietze transformations successively aplicable to {X\R) and 
{Y \S). Because of what was just said above, both procedures will necessarily 
reach presentations of the desired form in finite time. When knowing the 
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parameters m,n,m' ,n' we apply Observation 1.1 and conclude that {X \ R) and 
{Y \ S) are isomorphic if and only ii n = n' and m = m! . (This is a brute force 
algorithm, very far from being efficient from a computational point of view.) □ 



3 Finite index subgroups 

In this section, the goal is to find an algorithm solving the Finite Index Problem 
in a free-abelian times free group G: 

Problem 3.1 (Finite Index Problem, FIP(G)). Given a finite listwi, ■ . . ,Ws 
of elements in G, decide whether the subgroup H = {wi, . . . ,Ws) is of finite 
index in G and, if so, compute the index an a system of right (or left) coset 
representatives for H . 

To start, we remind that this same algorithmic problem is well known to 
be solvable both for free-abelian and for free groups. Given several vectors 
Wi, . . . , Wg 6 Z™, the subgroup H = {w^, . . . ,Ws) is of finite index in Z™ if and 
only if it has rank m. And here is an algorithm to make such a decision, and (in the 
affirmative case) to compute the index [Z™ : H] and a set of coset representatives 
for H: consider the s x m integral matrix W whose rows are the Wi's, and 
compute its Smith normal form, i.e. PW = d'mg{di,d2, . . . ,dr,Q, . . . , 0)Q, where 
P 6 GLs(Z), Q 6 GLm(Z), di,...,dr are non-zero integers each dividing the 
following one, di \ d2 \ ■■• | + 0, the diagonal matrix has size s x m, and 
r = rk(W) ^ min{s,m} (fast algorithms are well known to compute all these 
from W, see [i] for details). Now, if r < to then [Z™ : H] = oo and we are 
done. Otherwise, H is the subgroup generated by the rows of (W and so those 
of) PW, i.e. the image under the automorphism Q:Z^" Z™, v i-^ vQ of the 
subgroup H' generated by the simple vectors (di, 0, . . . , 0), . . . , (0, . . . , 0, dm)- 
It is clear that [Z™ : H'] = did2---dm, with {(ri,...,rm) | e [di]} being a 
set of coset representatives for H' . Hence, [Z™ : H] = did2---dm as well, with 
{(ri, . . . , rm)Q I ri 6 [di]} being a set of coset representatives for H. 

On the other hand, the subgroup H = (wi, . . . ,Ws) ^ has finite index if 
and only if every vertex of the core of the Schreier graph for H , denoted S{H), 
are complete (i.e. have degree 2n); this is algorithmically checkable by means of 
fast algorithms. And, in this case, the labels of paths in a chosen maximal tree 
T from the basepoint to each vertex (resp. from each vertex to the basepoint) 
give a set of left (resp. right) coset representatives for H, whose index in F„ 
is then the number of vertices of S{H). For details, see [24] for the classical 
reference or [16] for a more modern and combinatorial approach. 

Hence, FIP(Z'") and FIP(F„) are solvable. In order to build an algorithm 
to solve the same problem in Z™ x Fn, we shall need some well known basic 
facts about indices of subgroups that we state in the following two lemmas. For 
a subgroup ^ G of an arbitrary group G, we will write H ^f .j. G to denote 
[G:H] <oo. 
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Lemma 3.2. Let G and G' be arbitrary groups, p'-G ^ G' an epimorphism 
between them, and let H ^ G and H' ^ G" be arbitrary subgroups. Then, 

(i) [G" : Hp] ^ [G : H]; m particular, if H ^fA, G then Hp ^f.;. G' . 

(ii) [G" : H'] = [G : H'p-^]; m particular, H' ^f.i. G" if and only ifH'p-^ ^f.i. G. 

□ 

Lemma 3.3. Let Z and F be arbitrary groups, and let H ^ Z x F be a subgroup 
of their direct product. Then 

[ZxF:H]^[Z:HnZ]-[F:HnF], 

and 

iJ^f.i.ZxF o HnZ^f,i,Z andHnF^i,i,F. 
Proof. It is straightforward to check that the map 



Z/{HnZ) X F/{HnF) ^ {ZxF)/H 
{z-{HnZ), f-{HnF)) ^ zf-H 



(3.1) 



is well defined and onto; the inequality and one implication follow immediately. 
The other implication is a well know fact. □ 

Let G = Z'" X Fn, and let be a subgroup of G. If H <f.i. G then, applying 
Lemma 3.2 (i) to the canonical projections t:G ^ and tt:G ^ Fn, we have 
that both indices [Z"* : Ht] and [F„ : Hir] must also be finite. Since we can 
effectively compute generators for Hn and for Ht, and we can decide whether 
Ht ^ f .i. Z"* and Hit ^ f .i. F„ hold, we have two effectively checkable necessary 
conditions for H to be of finite index in G: if either [Z™ : Ht] or [F„ : Hn] is 
infinite, then so is [G : H]. 

Nevertheless, these two necessary conditions together are not sufficient to 
ensure finiteness of [G : H], as the following easy example shows: take H = 
{sa, tb), a subgroup of G = Z^ x F2 = (s, i | [s, t]) x {a,b \ ). It is clear that Ht = 1? 
and H-K = F2 (so, both indices arc 1), but the index [Z^ x F2 : H] is infinite 
because no power of a belongs to H. 

Note that H n Z'" ^ iJr ^ Z™ and iJ n ^ Htt ^ and, according to 
Lemma 3.3, the conditions really necessary, and sufficient, for H to be of finite 
index in G are 

77.nG..|^"^'"^-^"' (3.2) 
iHnFn^f.i.Hir, and i?7r ^t.i. F„, 

both stronger than Ht Z™ and Hn 4t.i. Fn respectively (and none of them 
satisfied in the example above). This is the main observation which leads to the 
following result. 
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Theorem 3.4. The Finite Index Problem for IT^ x F„ is solvable. 

Proof. From the given generators for H, we start by computing a basis of H 
(see Proposition 1.9), 

{t^\...,t'^-',t'^iui,...,t""'M„-}, 

where ^ m' ^ m, ^ n' ^ p, L = (bi,...,bm') - Z'" with abehan ba- 
sis {bi, . . . , bm'}, ai,---,an' e Z™, and Htt = (iti, . . . , u„') ~ F„' with free 
basis {«!,...,«„'}. As above, let us write A for the n' xm integral matrix 
whose rows are ai e Z™, i e [n']. 

Note that L = (bi, . . . ,bm') - nZ™ (with the natural isomorphism b i-^ t'', 
changing the notation from additive to multiplicative). Hence, the first necessary 
condition in (3.2) is rk(L) = m, i.e. to' = m. If this is not the case, then 
[G : H] = oo and we are done. So, let us assume to' = m and compute a set of 
(right) coset representatives for L in Z™, say Z™ = CiL u ■■■ u c^L. 

Next, check whether Hn = {ui, . . . , has finite index in Fn (by computing 
the core of the Schreier graph of Hn, and checking whether is it complete or 
not). If this is not the case, then [G : H] = oo and we are done as well. So, let 
us assume Hit ^t.i. Fn, and compute a set of right coset representatives for Htt 
in F„, say F„ = ■i;i(i?7r) u ■•■ u ^^(i/Tr). 

According to (3.2), it only remains to check whether the inclusion HnFn ^ Htt 
has finite or infinite index. Call p: Fn' Z" the abstract abelianization map for 
the free group of rank n' (with free basis {ui, . . . ,m„'}), and A:Z" Z™ the 
linear mapping v i-^ vA corresponding to right multiplication by the matrix A. 
Note that 

HnFn = {weFn\OeC^,^H} = {weFn\ujAeL}^HTT, 

where u) = cup is the abelianization of the word lo which expresses w in the free 
basis {ui, . . . ,u„'} of Htt, i.e. Fn^ w = w(ui, . . . ,m„'), see Corollary 1.15. Thus, 
H n Fn is, in terms of the free basis {ui, . . . , u„'}, the successive full preimage 
of L, first by the map A and then by the map p, namely {L)A~^p~^, see the 
following diagram: 

Fn ^ Htt - Fn' ^ Z"' — ^ Z™ 

V/ V/ V/ V/ (^-^^ 

HnFn - {L)A-^p-^^ — I iL)A-^ ^ — i L 

Hence, using Corollary 3.2 (ii), \Htt : H n Fn] = [Fn' ■ {L)A^^p^^] is finite if and 
only if [Z"' : (L)A'^] is finite. And this happens if and only if Tk((L)A'^) = n'. 
Since rk((L)A-i) = ik{{L nlm{A))A-^) = rk(L n Im(yl)) + rk(ker(A)), we can 
immediately check whether this rank equals n' , or not. If this is not the case, 
then [Htt : H n F„] = [F„- : (i)A" V"^] = [2"' ■ {L)A-'^] = oo and we are done. 
Otherwise, {L)A'^ ^f.i. Z"' and so, HnFn ^f.i. -^tt and iJ ^f.i. G. 
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Finally, suppose ^f.i. G and let us explain how to compute a set of right 
coset representatives for H in G (and so, the actual value of the index [G : H]). 
Having followed the algorithm described above, we have Z™ = CiL u ■■■ u c^L 
and Fn = Vi{Htt) u---uvs{HTr). Furthermore, from the situation in the previous 
paragraph, we can compute a set of (right) coset representatives for {L)A~^ 
in Z" , which can be easily converted (see Lemma 3.2 (ii)) into a set of right 
coset representatives for H n F„ in Hit, say Htt = wi{H n Fn) u ■ ■ ■ u wt{H n Fn) . 

Hence, F„ = Uje[s] Uke[t] VjWk{H n F„), and [Fn : H n F„] = st. Combining 
this with Z™ = \Jie[r] ^^'(i/ nZ™), and using the map in the proof of Lemma 3.3, 

we get G = Z™ X = U,e[r] Uje[s] like[t] f'VjWuH . 

It only remains a cleaning process in the family of rst elements {f^^VjWk | 
i 6 [r], j 6 [s], fc € \t\} to eliminate possible duplications as representatives of 
right cosets of H (this can be easily done by several applications of the mem- 
bership problem for H, see Corollary 1.12). After this cleaning process, we get 
a genuine set of right coset representatives for H in G, and the actual value 
of [G : iJ] (which is at most rst). 

Finally, inverting all of them we will get a set of left coset representatives 
for H vclG. □ 

Regarding the computation of the index [G : iJ], we remark that the inequal- 
ity among indices in Lemma 3.3 may be strict, i.e. [G : i?] may be strictly less 
than rsi, as the following example shows. 

Example 3.5. Let G = 1? ^ F2 = {s ,t \ [s, i] ) x (a, 6 | ) and consider the (normal) 
subgroups H = {3,1"^ ,a,b'^ ,bab) and H' = {s,t'^ ,a,b'^ ,bab,tb) = {s,t'^,a,tb) of G 
(with bases {s,t'^,a,b'^,bab} and {s,t'^ ,a,tb} , respectively). We have H nl? = 
H' r\I? = {s,t^} ^2 and HnF2 = H'nF2 = {a,b'^,bab) ^2 ^2, but 

[Z^ X F2: H]=A=[Z^ : H n I?] ■[F2:Hn F2], 

while 

[Z^ X F2 : i/'] = 2 < 4 = [Z^ : H' n Z^] • [F2 : H' n F2I 

with (right) coset representatives {l,b,t,tb} and {l,t}, respectively. This shows 
that both the equality and the strict inequality can occur in Lemma 3.3. 

4 The coset intersection problem and Howson's 
property 

Consider the following two related algorithmic problems in an arbitrary group G: 

Problem 4.1 (Subgroup Intersection Problem, SIP(G)). Given finitely 
generated subgroups H and H' of G (by finite sets of generators), decide whether 
the intersection HnH' is finitely generated and, if so, compute a set of generators 
for it. 
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Problem 4.2 (Coset Intersection Problem, CIP(G)). Given finitely gen- 
erated subgroups H and H' of G (by finite sets of generators), and elements 
g, g' 6 G, decide whether the right cosets gH and g'H' intersect trivially or not; 
and in the negative case (i.e. when gH ng'H' = g"(H n H')), compute such 
ag"eG. 

A group G is said to have the Howson property if the intersection of every 
pair (and hence every finite family) of finitely generated subgroups H,H' <f g G 
is again finitely generated, H n H' ^t.g. G. 

It is obvious that satisfies Howson property, since every subgroup is 
free-abelian of rank less than or equal to m (and so, finite). Moreover, SIP(Z'") 
and CIP(Z™) just reduce to solving standard systems of linear equations. 

The case of free groups is more interesting. Howson himself established in 
1954 that Fn also satisfies the Howson property, see [14]. Since then, there has 
been several improvements of this result in the literature, both about shortening 
the upper bounds for the rank of the intersection, and about simplifying the 
arguments used. The modern point of view is based on the pull-back technique 
for graphs: one can algorithmically represent subgroups of Fn by the core of 
their Schreier graphs, and the graph corresponding to H n H' is the pull-back of 
the graphs corresponding to H and H' , easily constructible from them. This not 
only confirms Howson's property for Fn (namely, the pull-back of finite graphs 
is finite) but, more importantly, it provides the algorithmic aspect into the topic 
by solving SIP(f,i). And, more generally, an easy variation of these arguments 
using puUbacks also solves CIP(i^„), see Proposition 6.1 in [ ]. 

Baumslag [2] established, as a generalization of Howson's result, the conserva- 
tion of Howson's property under free products, i.e. if Gi and G2 satisfy Howson 
property then so does Gi x- G2 . Despite it could seem against intuition, the same 
result fails dramatically when replacing the free product by a direct product. 
And one can find an extremely simple counterexample for this, in the family of 
free-abelian times free groups; the following observation is folklore (it appears 
in [7] attributed to Moldavanski, and as the solution to exercise 23.8(3) in [4]). 

Observation 4.3. The group x F„, for m ^ 1 and 2, does not satisfy 
the Howson property. 

Proof. In Z X F2 = (i I ) X (a, & I ), consider the (finitely generated) subgroups 
H = {a,b) and H' = \ta,b). Clearly, 

HnH' = {w{a, 6) | w e F2} n {w{ta, b)\we F2} 

= {w{a, b)\weF2}n {tl""!" w(a, b)\we F2} 
= {t''w{a,b)\weF2, \w\a = 0} 
= {{b))F, = {a-''ba\ keZ), 

where |?z;|a is the total a-exponent of w (i.e. the first coordinate of the abelian- 
ization w e Z^ of w e F2). It is well known that the normal closure of b in F2 is 
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not finitely generated, hence Z x F2 does not satisfy the Howson property. Since 
Zx F2 embeds in Z™ x F„ for all m ^ 1 and n ^ 2, the group Z™ x Fn does not 
have this property either. □ 

We remark that the subgroups H and H' in the previous counterexample are 
both isomorphic to F2. So, interestingly, the above is a situation where two free 
groups of rank 2 have a non-finitely generated (of course, free) intersection. This 
does not contradict the Howson property for free groups, but rather indicates 
that one cannot embed H and H' simultaneously into a free subgroup of Z x F2 . 

In the present section, we shaU solve SIP(Z™xi^„) and CIPCZ^xF^). The key 
point is Corollary 1.8 : HnH' is finitely generated if and only ii {H n H')tt ^ Fn 
is finitely generated. Note that the group Htt n H'tt is always finitely generated 
(by Howson property of Fn), but the inclusion {H n H')Tr ^ Htt n H'tt is not 
(in general) an equality (for example, in Z x F2 = {t \ ) x {a, b \ ) , the subgroups 
H= {t^,ta^) and H' = \f,t^a^) satisfy € HttdH'tt but f (HnH')?:). This 
opens the possibility for {H n H')7t, and so HnH', to be non finitely generated, 
as is the case in the example from Observation 4.3. 

Let us describe in detail the data involved in CIP(G) for G = Z™ x Fn- By 
Proposition 1.9, we can assume that the initial finitely generated subgroups 
H,H' ^ G are given by respective bases i.e. by two sets of elements 

£; = {tb\...,t''-i,t=^^ui,...,t'^"iu„j, 

£;' = {tt''s...,t^-2,t=^'iu;,...,t<.<j, ^'^ 

where {ui, . . . ,Uni} is a free basis of Htt ^ Fn, {u'l, . . . ,u'n^} is a free basis of 
iJ'TT ^ Fn, {t^^ t""-! } is an abefian basis of iJ n Z™, and {t^'^ t^'-^ } is 
an abelian basis of H' n Z™. Consider the subgroups L = (bi, . . . ,bini) ^ Z™ 
and L' = (b'^, . . . , b^^) ^ Z™, and the matrices 



ai 



\ 

6^nixm(Z) and A': 



\ 

^Mn^xmi^)- 



We are also given two elements g = f^u and g' = f u' from G, and have to 
algorithmically decide whether the intersection gH n g' H' is empty or not. 

Before start describing the algorithm, note that Htt is a free group of rank rii. 
Since {ui, . . . ,Wni} is a free basis of Htt, every element w e Htt can be written 
in a unique way as a word on the Ui's, say w = . . . , u„i ). Abelianizing this 

word, we get the abelianization map pi-Htt Z"^, w 1-^ u) (not to be confused 
with the restriction to Htt of the ambient abelianization _F„ -» Z" , which will 
have no role in this proof). Similarly, we define the morphism P2-H'tt Z"^. 

With all this data given, note that gH n g'H' is empty if and only if its 
projection to the free component is empty, 

gHng'H' = ^ (gH n g' H')tt = 0; 
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so, it will be enough to study this last projection. And, since this projection 
contains precisely those elements from {gH)Tr n (g'H')TT = {u ■ Hit) n {u' • H'tt) 
having compatible abelian completions in gH n g'H', a direct application of 
Lemma 1.13 gives the following result. 

Lemma 4.4. With the above notation, the projection (gH n g' H')-k consists 
precisely on those elements v e (u- Hir) n (u' ■ H't:) such that 

Ny = {a + LjA + L)n (a' + w'A' + L') + 0, (4.2) 

where ijJ = wpi and uj' = w' p2 are, respectively, the abelianizations of the abstract 
words UJ € Fn-^ and ui' 6 Fn^ expressing w = u^^v e Htt ^ Fn and w' = u'^^v e 
H'tt ^ Fn in terms of the free bases {ui, . . . ,ii„j} and {u[, . . . ,u'n^} (i.e. u- 
io{ui, . . . ,-u„J = w = m' ■ . . . That is, 

{gH n g'H')7: = {ve{u- Hit) n (u' ■ H't:) | + } c (m . Hn) n (u' ■ H'tt) □ 

Theorem 4.5. The Coset Intersection Problem for Z™ x F„ is solvable. 

Proof. Let G = Z™ x Fn be a finitely generated free-abelian times free group. 
Using the solution to CIP(i^„), we start by checking whether {u- Htt) n (u' • H' tt) 
is empty or not. In the first case {gH n g' H')it, and so gH n g' H' , will also be 
empty and we are done. Otherwise, we can compute ^ Fn such that 

(u ■ Htt) n {u' ■ H'tt) = vq ■ (Htt n H'n) , (4.3) 

compute words ojq e Fn-^ and uj'q e such that u ■ ujq{ui, . . . ,Un-^) = vq = 
u'-uiq{u[, . . . ^u'n^), and compute a free basis, {vi, . . . jVn^}, for HTrnH'iT together 
with expressions of the Vi's in terms of the free bases for Htt and H'tt, Vi = 
z/j(mi,...,m„J = v[{u[,...,u'^^), ie [rig]. 

Let p^: Httd H'tt ^ Z"^ be the corresponding abelianization map. Abelian- 
izing the words Vi and i/^', we can compute the rows of the matrices P and P' 
(of sizes ng, x m and 713 x 712, respectively) describing the abelianizations of the 

inclusion maps Htt <^ Htt n H'tt ^ H'tt, see the central part of the diagram (4.4) 
below. 

By (4.3), u^^Vf) 6 Htt and u'^^vq e H'tt. So, left translation by Wq = u'^Vq is 
a permutation of Htt (not a homomorphism, unless wq = 1), say X^^-Htt -> Htt, 
X I-*- wqx = u^^vqx. Analogously, we have the left translation by w'q = u'^^vq, 
say Xw'-H'tt H'tt, x >^ w'qX = u'^^vqx. We include these translations in our 
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diagram: 



{HnH')TT 




where = i^oPi s and ui^ = w'^p2 e Z"^ are the abehanizations of wq and 
w'q with respect to the free bases {ui, . . . and {u'l, . . . ,u'^^}, respectively. 

Now, for every v € (u-HTT)n(u'-H'TT), using Lemma 4.4 and the commutativity 
of the upper part of the above diagram, we have 



7V„ = (a + {u-^v)piA + L)n (a' + {u'-\)p2A' + L') 

= (a + {v„^v)LXn,„piA + L)n (a' + {v„^v)l' X^'^p2A' + L') 

= (a + (a;o + {v-^\)p^V)A + L) n (a' + K + {v-^\)p:iP')A' + L') 

= (a + (jJqA + {v'^^v)pzPA + L)n (a' + w^A' + {vq^v)p3P'A' + L') . 

With this expression, we can characterize, in a computable way, which 
elements from (u • Htt) n {u' ■ H'tt) do belong to {gH n g' H')tt: 

Lemma 4.6. With the current notation we have 

{gH n g'H')Ti = Mp^^Xvo ^ ' Htt) n (u' ■ H'n), (4.5) 

where AI £ Z"^ «s the preimage by the linear mapping PA - P'A':Z"-' ^ Z™ o/ 
</ie linear variety 

7V = a'-a+u;oA'-u;oA + (L + L') £2"- (4-6) 

Proof. By Lemma 4.4, an element w e {u-HTr)n{u' -H'tt) belongs to {gHng' H')n 
if and only if + 0. That is, if and only if the vector x = (uq^w)p3 e Z"^ 
satisfies that the two varieties a + u3qA + xPA + L and a' + ti^^A' + xP'A' + L' 
do intersect. But this happens if and only if the vector 

(a + a;oA + xPA) - (a' + ui'^A' + xP'A') = a - a' + UqA - lj'qA' + x(PA - P'A') 

belongs to L + L' . That is, if and only if x(PA - P'A') belongs to N. Hence, 
V belongs to {gH n g' H')tt if and only if x = (i;q^w)/93 e A/, i.e. if and only if 

veMp-^^K^. □ 
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With all the data already computed, we explicitly have the variety N and, 
using standard linear algebra, we can compute M (which could be empty, because 
N may possibly be disjoint with the image of PA - P'A'). In this situation, the 
algorithmic decision on whether gH n g' H' is empty or not is straightforward. 

Lemma 4.7. With the current notation, and assuming that {u-HTT)n(u' -H'tt) + 
0, the following are equivalent: 

(a) gHng'H' = 0, 

(b) {gHng'H')7T = 0, 

(c) Mpgi = 0, 

(d) M = 0, 

(e) 7VnIm(PA-P'A') = 0. □ 

If gH n g'H' = 0, we are done. Otherwise, N n Im(PA - P'A') i= and 
we can compute a vector x e Z"^ such that x(PA - P'A') e N. Take now any 
preimage of x by pa, for example w^^---t;„3^ if x = (xi, . . . ,Xna), and by (4.5), 
u" = vov'[^-Vn^^ 6 {gHng'H')Tr. 

It only remains to find a" e Z™ such that g" = t"^" u" e gHng'H'. To do this, 
observe that u" e {gH n g'H')Ti implies the existence of a vector a" such that 
^'''u" 6 f^uH n f^' u' H' , i.e. such that t''"~'^u-^u" e H and t''"-'^' u'-^u" e H' . 
In other words, there exists a vector a" e Z™ such that a" - a e C„-i„" and 
a" - a' 6 C„'-i„" }ji . That is, the afhne varieties a + Cj,-i„" u and a' + C„'-i„" do 
intersect. By Corollary 1.15, we can compute equations for these two varieties, 
and compute a vector in its intersection. This is the a" 6 Z™ we are looking 
for. □ 

The above argument applied to the case where g = g' = \ is giving us valuable 
information about the subgroup intersection H nH'; this will allow us to solve 
SIP(Z™ X Fn) as well. Note that, in this case, a = a' = 0, u = u' = 1 and so, 
vq = 1, wq = w'q = 1, and ujq = u}'g = 0. 

Theorem 4.8. The Subgroup Intersection Problem for Z™ x Fn is solvable. 

Proof. Let G = Z'" x Fn be a finitely generated free-abelian times free group. 
As in the proof of Theorem 4.5, we can assume that the initial finitely gen- 
erated subgroups H,H' ^ G are given by respective bases, i.e. by two sets 
of elements like in (4.1), E = {t''! , . . . , t*"-! , f^iui, . . . , f^-i m„,} and E' = 
{t*'i,...,t'''"'2,t'*iui,...,t''"2u;j. Consider the subgroups L,L' ^ Z™ and 
the matrices A e A^„^xm(Z) and A' e A^„2xm(2) as above. We shall algorith- 
mically decide whether the intersection H n H' is finitely generated or not and, 
in the affirmative case, shall compute a basis for H n H' . 

Let us apply the algorithm from the proof of Theorem 4.5 to the cosets 1 • H 
and 1-H'; that is, take g = g' = 1, i.e. u = u' = 1 and a = a' = 0. Of course, HnH' 
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is not empty, and vq = 1 serves as an element in the intersection, vq e H n H' . 
With this choice, the algorithm works with wq = w'q = 1 and = = (so, we 
can forget the two translation parts in diagram (4.4)). Lemma 4.6 tells us that 
{HnH')TT = Afpgi < HnnH'TT, where M is the preimage by the linear mapping 
PA - P'A':Z"3 ^ Z"i of the subspace N = L + L' ^Z"". In this situation, the 
following lemma decides when is H n H' finitely generated and when is not: 

Lemma 4.9. With the current notation, the following are equivalent: 

(a) H n H' is finitely generated, 

(b) (H n H')tt is finitely generated, 

(c) Mp^^ is either trivial or of finite index in Hnn H'tt, 

(d) either = I and M = {0}, or M is of finite index in Z"^, 

(e) either = 1 and Af = {0}, or rk(Af) = ^3. 

Proof, (a) o (b) is in Corollary 1.8. (b) (c) comes from the well known fact 
(see, for example, [i.'-] pags. 16-18) that, in the finitely generated free group 
Htt n H'-K, the subgroup {H n H')tt = Mp^ is normal and so, finitely generated 
if and only if it is either trivial or of finite index. But, by lemma 3.2 (ii), the 
index [i/7r n H'-k : Mp^\ is finite if and only if [Z"^ : M\ is finite; this gives (c) 
o (d). The last equivalence is a basic fact in linear algebra. □ 

We have computed 77,3 and an abelian basis for M . If ^3 = we immediately 
deduce that H n H' is finitely generated. If 71.3 = 1 and M = {0} we also deduce 
that H n H' is finitely generated. Otherwise, we check whether rk{M) equals 
713; if this is the case then again H n H' is finitely generated; if not, H n H' is 
infinitely generated. 

It only remains to algorithmically compute a basis for H n H', in case it is 
finitely generated. We know from (1.5) that 

HnH' = {{Hn H') n Z'") x {H n H')Tra, 

where a is any splitting for iT\HnH'- H n H' ^ {H n H')tt; then we can easily get 
a basis oi H n H' by putting together a basis of each part. The strategy will be 
the following: first, wc compute an abelian basis for 

{H n H') n Z™ = {H n Z'") n {H' n Z") = i n L' 

by just solving a system of linear equations. Second, we shall compute a free 
basis for {H r\ H')tt. And finally, we will construct an explicit splitting a and 
will use it to get a free basis for {H n H')na. Putting together these two parts, 
we shall be done. 

To compute a free basis for (H n H')7t note that, if = 0, or 713 = 1 and 
M = {0}, then {H n H')7r = 1 and there is nothing to do. In the remaining case, 
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rk(Af) = rt3 ^ 1, Mp^^ = {H n H'^n has finite index in Htt n H'lr, and so it is 
finitely generated. We give two alternative options to compute a free basis for it. 

The subgroup M has finite index in Z"^ , and we can compute a system of 
coset representatives of Z"^ modulo M, 

Z"^ = Mci u-u A/Cd 

(see the beginning of Section 3). Now, being p^ onto, and according to Lemma 3.2 (b), 
we can transfer the previous partition via pa to obtain a system of right coset 
representatives of Hit n H'tt modulo Mp^^: 

HnnH'n = {Mp2^)zi u-u {Mp^^)zd, (4.7) 

where we can take, for example, Zi = u^''^W2''^"- fnj"^ e Ht: n H'tt, for each vector 
Ci = (ci,i, Ci^2, • ■ ■ , Ci,n3 ) s Z"^, i 6 [d]. Now let us construct the core of the 
Schreier graph for Mp^^ = {H nH')7T (with respect to {vi, . . . ,Vn^}, a free basis 
for Htt n H'tt), S{Mp^^), in the following way: consider the graph with the 
cosets of (4.7) as vertices, and with no edge. Then, for every vertex {Mp^^)zi 
and every letter vj, add an edge labeled Vj from {Mp^^)zi to {Mp^^)ziVj, 
algorithmically identified among the available vertices by repeatedly using the 
membership problem for Mp^^ (note that we can do this by abelianizing the 
candidate and checking the defining equations for M). Once we have run over 
all we shall get the full graph S{Mp^^), from which we can easily obtain a 
free basis for {H n H')tt in terms of {vi, . . . , Vn-^}- 

Alternatively, let {mi , . . . , } be an abelian basis for M (which we already 
have from the previous construction), say mi = (mi_i, 771^ 2, w^^ng) e Z"^, 
I = 1, . . . , na, and consider the elements Xi = i;™'"^?;™''^"- u^'""^ € Htt n H'tt. It 
is clear that Mp^-^ is the subgroup of Htt n H'tt generated by xi, . . . , and 
all the infinitely many commutators from elements in Htt n H'tt. But Mp^^ 
is finitely generated so, finitely many of those commutators will be enough. 
Enumerate all of them, yi,y2,. . ■ and keep computing the core Sj of the Schreier 
graph for the subgroup {xi, . . . ,a;„3,?/i, . . . ,yj) for increasing j's until obtaining 
a complete graph with d vertices (i.e. until reaching a subgroup of index d). 
When this happens, we shall have computed the core of the Schreier graph for 
Afpg^ = {HnH')TT (with respect to {vi, . . . , Vn-^}, a free basis of Httd H'tt), from 
which we can easily find a free basis for {H n H')tt, in terms of {vi, . . . , Vns}- 

Finally, it remains to compute an explicit splitting a for tt^ij^^u,: H n H' 
{H n H')tt. We have a free basis {zi,...,Zd} for {H n H')tt, in terms of 
{vi, . . . ,Vn3}; so, using the expressions Vi = j/j(Mi, . . . , u„j ) that we have from 
the beginning of the proof, we can get expressions Zi = rii{ui, . . . ,Un^). From 
here, 7yi(t'^iui, . . . ,t'*"iM„j) = f^'z, e H and projects to z^, so Cz^^h = ei + L 
(see Corollary 1.15), i € [d]. Similarly, we can get vectors ej e Z™ such that 
Czi,H' = ej + L'. Since, by construction, Czi.HnH' = Czi,H <~'Czi.H' is a non-empty 
affine variety in Z™ with direction Ln L' , we can compute vectors e" e Z™ on 
it by just solving the corresponding systems of linear equations, i e [d]. Now, 
Zi 1-^ f^' Zi is the desired splitting H n H' ^ {H n H')tt, and {t^^zi, . . . ,t^'^Zd} 
is the free basis for {H n H')TTa we were looking for. 
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As mentioned above, putting together this free basis with the abehan basis 
we aheady have for Ln L' , we get a basis for H n H', concluding the proof. □ 

Corollary 4.10. Let H,H' be two free non-abelian subgroups of finite rank in 
Z™ X Fn . With the previous notation, the intersection H nH' is finitely generated 
if and only if either H n H' = 1, or PA = P'A'. 

Proof. Under the conditions of the statement, we have L = L' = {0}. Hence, 
N = L + L' = {0} and its preimage by PA - P'A' is M = ker(PA - P'A') ^ Z"-' . 
Now, by Lemma 4.9, HnH' is finitely generated if and only if either {HnH')TT = 
Mpl^ = 1, or 713 -rk(/TO(PA - P'A')) = rk(M) = na; that is, if and only if either 
{H n H')tt = 1, or PA = P'A'. But, since L = L' = {0}, {H n H')Tr = 1 if and 
onlyif i7ni7' = l. □ 

We consider the following two examples to illustrate the preceding algorithm. 

Example 4.11. Let us analyze again the example given in the proof of Obser- 
vation 4.3, under the light of the previous corollary. We considered in Z x F2 = 
{t \ ) X {a,b \ ) the subgroups H = (a, b) and H' = {ta, b), both free non-abelian of 
rank 2. It is clear that A = ( g ) and A' = ( J ), while Hn = H'n = Hnn H'n = F2; 
in particular, 713 = 2 and H n H' i= 1. In these circumstances, both inclusions 
Hn ^ Htt n H'tt ^ H'tt are the identity maps, so P = P' = 1 is the 2x2 identity 
matrix and hence, PA = (q) + (J) = P'A'. According to Corollary 4.10, this 
means that HnH' is not finitely generated, as we had seen before. 

Example 4.12. Consider two finitely generated subgroups H,H' 4 F„ ^ Z™ x F„. 
In this case we have A = (0) e Mni,7n and A' = (0) € Mn-2,m and so, PA = (0) = 
P'A'. Thus, Corollary 4.10 just corroborates Howson's property for finitely 
generated free groups. 

To finish this section, we present an application of Theorem 4.8 to a nice 
geometric problem. In the very recent paper [23], J. Sahattchieve studies quasi- 
convexity of subgroups of Z"* x F„ with respect to the natural component-wise 
action of Z™ x F„ on the product space, E™ x , of the TTi-dimensional euclidean 
space and the regular (2n)-valent infinite tree T„: a subgroup H ^ Z™ x F„ is 
quasi-convex if the orbit Hp of some (and hence every) point p 6 x T„ is a 
quasi-convex subset of IR™ x T„ (see ['J ] for more details). One of the results 
obtained is the following characterization: 

Theorem 4.13 (Sahattchieve). Let H be a subgroup of'L™' x F„. Then, H is 
quasi-convex if and only if H is either cyclic or virtually of the form Ax B, for 
some A ^ Z™ and B ^ Fn being finitely generated. (In particular, quasi-convex 
subgroups are finitely generated.) 

Combining this with our Theorem 4.8, we can easily establish an algorithm 
to decide whether a given finitely generated subgroup of Z™ x F„ is quasi-convex 
or not (with respect to the above mentioned action). 
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Corollary 4.14. There is an algorithm which, given a finite list wi, . . . ,Ws of 

elements in Z™ x Fn, decides whether the subgroup H = {wi, . . . ,Ws) is quasi- 
convex or not. 

Proof. First, apply Proposition 1.9 to compute a basis for H. If it contains only 
one element, then H is cyclic and we are done. 

Otherwise {H is not cyclic) we can easily compute a free-abelian basis and a 
free basis for the respective projections Ht ^ Z™ and Htt < F„. From the basis 
for H we can immediately extract a free-abelian basis for Z™ nH = Ht n H. And, 
using Theorem 4.8, we can decide whether FnH H = Hit n H is finitely generated 
or not and, in the affirmative case, compute a free basis for it. Finally, we can 
decide whether Ht n H ^f .j. Ht and Htt n H ^f .j. Htt hold or not (applying the 
well known solutions to FIP(Z™) and FIP(F„') or, alternatively, using the more 
general Theorem 3.4 above); note that if we detected that Htt n if is infinitely 
generated then it must automatically be of infinite index in Hn (which, of course, 
is finitely generated). 

Now we claim that H is quasi-convex if and only if Ht n H ^ t.i. Ht and 
Htt n H ^f.j. Htt; this will conclude the proof. 

For the implication to the right (and applying Theorem 4.13), assume that 
Ax B 4 f j H for some A 4 Z™ and B 4 Fn being finitely generated. Applying 
T and TT we get A ^ f.j. Tir and B ^ t i. TJtt, respectively (see Lemma 3.2 (i)). 
But A ^ Ht n H ^ Ht and B ^ Htt n H 4 Htt hence, Ht n H ^ f .i. Ht and 
iJ-TrniJ ^f.i. iivr. 

For the implication to the left, assume Ht n H ^f.j. Ht and Htt n H ^f.i. Htt 
(and, in particular, Htt n H finitely generated). Take A = Ht n H <f.i. Ht < Z™ 
and B = Htt n H ^f.j. Htt ^ F„, and we get Ax B ^f.j. Ht x Htt (see Lemma 3.3). 
But H is in between, A x B 4 H ^ Ht x Htt, hence A x B 4 f j. H and, by 
Theorem 4.13, H is quasi-convex. □ 

5 Endomorphisms 

In this section we will study the endomorphisms of a finitely generated free- 
abelian times free group G = Z™ x Fn (with the notation from presentation (1.2)). 
Without loss of generality, we assume n+1. 

To clarify notation, we shall use lowercase Greek letters to denote endo- 
morphisms of F„, and uppercase Greek letters to denote endomorphisms of 
G = Z™ X Fn- The following proposition gives a description of how all endomor- 
phisms of G look like. 

Proposition 5.1. Let G = Z™ x F„ with n+1. The following is a complete list 
of all endomorphisms of G: 

(I) *0,Q,p = f'u ^ t'^'^+'^P where (f) e End(K), Q e Mm{Z), and P e 
Mn.M. 
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(II) *z,i.h,Q,p = ^aQ+uP^af+uh^^ where 1 + ze Fn is not a proper power, 

Q € !m„(Z), P € A^„x„(Z), # 1 € Z™, and h € Z". 

(In hath cases, u e Z" denotes the abelianization of the word Fn.) 

Proof. It is straightforward to check that all maps of types (I) and (II) are, in 
fact, endomorphisms of G. 

To see that this is the complete list of all of them, let ^ftG ^ G be an 
arbitrary endomorphism of G. Looking at the normal form of the images of the 
a;,'s and tj^s, we have 

f''"' (5.1) 

where Pi,c|j e Z™ and Wi, zj e Fn, i e [n], j e [m]. Let us distinguish two cases. 

Case 1: Zj = 1 for all j 6 [m]. Denoting </> the endomorphism of F^ given by 
Xi >^ Wi, and P and Q the following integral matrices (of sizes n x m and mxm, 
respectively) 



(Pn ■■■ Plm \ 
i .. : 

Pn\ Pnm 

we can write 




qim \ 



qi \ 



( \ 

■ and Q 

K Pn J \ Qml ••• Qmm / \ ^Im / 



where u e F„ and a e Z™. So, (f'u)* = f^^+^^u^ and * equals *,|i,Q,p from 
type (I). 

Case 2: z^ + \ for some k € [m]. For \1/ to be well defined, t^'Wi and 
fJ^j must all commute with f^^Zk, and so Wi and with Zk '^, for all 
i € [n] and j e [to]. This means that Wi = z^^ , Zj = z'^ for some integers 
hi, Ij € Z, i € [n], j € [to], with Ik + 0, and some z e F^ not being a proper 
power. Hence, (f'u)* = (t'^*)(ttf) = (t^'^z^'')(t"Pz"''') = t**^^"^^*''^"''' and 
"J" equals 'J'z,i,h,Q,p from type (II). 

This completes the proof. □ 

Note that if n = then type (I) and type (II) endomorphisms do coincide. 
Otherwise, type (II) endomorphisms will be seen to be neither injective nor 
surjective. The following proposition gives a quite natural characterization of 
which endomorphisms of type (I) are injective, and which arc surjective. It is 
important to note that the matrix P plays absolutely no role in this matter. 

Proposition 5.2. Let ^ he an endomorphism ofG = Z™ x F„, with n ^ 2. Then, 

(i) ^ is a monomorphism if and only if it is of type (I), ^ = ^4,,q,p, with (f) a 
monomorphism of Fn, and det(Q) # 0, 
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(ii) ^' is an epimorphism if and only if it is of type (I), ^ = ^'<^,q,p, with (j) an 
epimorphism of Fn, and det(Q) = ±1. 

(iii) 4* is an automorphism if and only if it is of type (I), ^' = ^'^.q.p, with (f> e 
Aut(i^„) and Q € GLmil); in this case, (v1/,/,,q,p)"^ = ^'0-i,q-i -m-ipq-i, 
where M e GL„(Z) is the abelianization of (j). 

Proof, (i). Suppose that ^ is injective. Then ^ can not be of type (II) since, if it 
were, the commutator of any two elements in Fn (n ^ 2) would be in the kernel of 
Hence, * = *<^,q,p for some (p € End(i^„), Q € Mmi^), and P € Mnxmi^)- 
Since t*^ = t^*^, the injectivity of ^ implies that of a aQ; hence, det(Q) + 0. 
Finally, in order to prove the injectivity of (f>, let u e F„ with u4> = 1. Note that 
the endomorphism of Q™ given by Q is invertible so, in particular, there exist 
V e such that vQ = uP; write v = ^a for some a e and 6 e Z, 6*0, and 
we have aQ = 6vQ = 6uP; thus, (t^u"^)* = t*Q(t"^l)-^ = t^Q-b^^ = t" = 1. 
Hence, t^vr^' = 1 and so, u = 1. 

Conversely, let \l/ = ^'0,q,p be of type (I), with (p a monomorphism of F„ and 
det(Q) * 0, and let t^u e G be such that 1 = (t^u)* = t*Q+"^ ucp. Then, u(t) = l 
and so, u = 1; and = aQ + uP = aQ and so, a = 0. Hence, ^ is injective. 

(ii) . Suppose that ^ is onto. Since the image of an endomorphism of type (II) 
followed by the projection tt onto F„, n ^ 2, is contained in (z) (and so is 
cyclic), ^' cannot be of type (II). Hence, = 5'0,q,p for some (f) e End(F„), 
Q s MmC^), and P € MnxmC^)- Given i> € F„ < G there must be f^u € G such 
that (t^'u)^' = V and so U(p = v. Thus (p-F^ Fn is onto. On the other hand, 
for every j e [m], let dj be the canonical vector of Z™ with 1 at coordinate j, 
and let t^^uj € G be a pre-image by v]/ of tj = t^K We have {t^iuj)'i = t^j, i.e. 

= 1, Uj = and bjQ = bjQ + ujP = (5j. This means that the matrix B with 
rows bj satisfies BQ = Im and thus, det(Q) = ±1. 

Conversely, let ^! = ^'^.q.p be of type (I), with (j) being an epimorphism of 
Fn and dct(Q) = ±1. By the hopfianity of Fn, 4> ^ Aut(F„) and we can consider 
T = *,/,-i,Q-i -M-ipQ-ii where M e GL„(Z) is the abelianization of <p. For every 
t^u e G, we have 

Hence, ^ is onto. 

(iii) . The equivalence is a direct consequence of (i) and (ii). To see the actual 
value of it remains to compute the composition in the reverse order: 

(t^«)*T = (t^<^^"P(w0))T = e+"PQ-'-uMM-^PQ-^^ ^ □ 

Immediately from these characterizations for an endomorphism to be mono, 
epi or auto, we have the following corollary. 

Corollary 5.3. Z™ x F„ is hopfian and not cohopfian. □ 
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The hopfianity of free-abelian times free groups was already known as part 
of a bigger result: in [L-:!] and [I j] it was shown that finitely generated partially 
commutative groups (this includes groups of the form G = x F„) are residually 
finite and so, hophian. However, our proof is more direct and explicit in the 
sense of giving complete characterizations of the injectivity and surjectivity of a 
given endomorphism of G. We remark that, despite it could seem reasonable, 
the hophianity of Z™ x F„ does not follow directly from that of free-abelian 
and free groups (both very well known): in [2()], the author constructs a direct 
product of two hophian groups which is not hophian. 

For later use, next lemma summarizes how to operate type (I) endomorphisms 
(compose, invert and take a power); it can be easily proved by following routine 
computations. The reader can easily find similar equations for the composition 
of two type (II) endomorphisms, or one of each (we do not include them here 
because they will not be necessary for the rest of the paper). 

Lemma 5.4. Let ^'^.q.p and ^0'.q'.p' he two type (I) endomorphisms of G = 
Z™ X Fn, n+ 1, and denote 6?/ M e A^„(Z) the (matrix of the) abelianization of 
^€End(K). Then, 

(i) ^0,Q,P • *0',Q',P' = ^</>0',QQ',PQ'+MP'; 

(ii) for all k^l, (*0,Q,p)'= = *0^Q^P^, where Pk = Zti 

(iii) \E'0,Q,p is invertible if and only if (j) s Aut(_F'„) and Q e GL„i(Z); in this 
case, {^^.Q.p)~^ = *0-i,Q-i -M-ipQ-i- 

(iv) For every a e Z™ and u e Fn, the right conjugation by f^u is Ftau = 
^7u,i„,0; where 'y^ is the right conjugation by u in Fn, v i-^ u^^vu, Im is 
the identity matrix of size m, and is the zero matrix of size nx m. □ 

In the rest of the section, we shall use this information to derive the structure 
of Aut(G'), where G = Z™ x i^„, m ^ 1, n ^ 2. 

Theorem 5.5. For G = Z™ x Fn, with m ^ 1 and n ^ 2, the group Aut(G') 
is isomorphic to the semidirect product A^„xm(Z) x (Aut(i^„) x GLm(Z)) with 
respect to the natural action. In particular, Aut(G) is finitely presented. 

Proof. First or all note that, for every 0, (j)' e Aut(F„), every Q, Q' e GLm(Z), 
and every P, P' e A^„xm(Z), we have 

^/„,Q,0 ■ 'I'/„,Q%0 = 'J'/„,QQ',0 
^'/„,I„,P • P' = */„,I„,P+P'- 

Hence, the three groups Aut(F„), GLm(Z), and A^„xm(Z) (this last one with the 
addition of matrices), are all subgroups of Aut(G) via the three natural inclusions: 
4> ^ ^0,i„,o, Q ^ ^/„,Q,o, and P i-^ ^'/„.i^,p, respectively. Furthermore, for 
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every (j) ^ Aut(F„) and every Q 6 GLm(Z), it is clear that 4'0,i„,o • ^'/„,q,o = 
^'/„,Q,o • ^0,i„,o; hence Aut(F„) x GL„j(Z) is a subgroup of Aut(G') in the 
natural way. 

On the other hand, for every (f) e Aut(F„), every Q e GLm(Z), and every 
P 6 A^„xm(Z), we have 

(*0j„,o)"^ ■ */„,i„,p ■ ^-^J^^o = *0-i,i„.o ■ *0,i„,p = i„,M-ip, (5.2) 
where M e GL„(Z) is the abelianization of 0, and 

(*/„,Q,o)"^ • */„.I„,P ■ */„.Q.O = */„,Q-i,0 ■ */„,Q.PQ = */„J„,PQ- (5.3) 

In particular, Mnxm{'^) is a normal subgroup of Aut(G'). But Aut(i^„), GLto(Z) 
and A^„xm(Z) altogether generated the whole Aut(G), as can be seen with the 
equality 

*0,Q,P = */„,I„,PQ-i • */„,Q,o ■ *0,I„,O- (5.4) 

Thus, Aut(G') is isomorphic to the scmidircct product yW„xm(Z) ^ (Aut(F„) x 
GL„i(Z)), with the action of Aut(F„) x GL„i(Z) on A^„xm(Z) given by equa- 
tions (5.2) and (5.3). 

But it is well known that these three groups are finitely presented: A^„xm(Z) ~ 
jnm -g free-abelian generated by canonical matrices (with zeroes everywhere 
except for one position where there is a 1), GLm(Z) is generated by elementary 
matrices, and Aut(i^„) is generated, for example, by the Nielsen automorphisms 
(see [J>i] for details and full finite presentations). Therefore, Aut(G) is also 
finitely presented (and one can easily obtain a presentation of Aut(G) by taking 
together the generators for A1„xm(2)7 Aut(F„) and GL„(Z), and putting as 
relations those of each of M.nxm{'^)^ Aut(F„) and GLm(Z), together with the 
commutators of all generators from Aut(i^„) with all generators from GLm(Z), 
and with the conjugacy relations describing the action of Aut(F„) x GL,„(Z) on 
■A^nxm(Z) analyzed above). □ 

Finite presentability of Aut(G) was previously known as a particular case 
of a more general result: in [i , ], M. Laurence gave a finite family of generators 
for the group of automorphisms of any finitely generated partially commutative 
group, in terms of the underlying graph. It turns out that, when particularizing 
this to free-abelian times free groups, Laurence's generating set for Aut(G) 
is essentially the same as the one obtained here, after deleting some obvious 
redundancy. Later, in ['.)], M. Day builts a kind of peak reduction for such 
groups, from which he deduces finite presentation for its group of automorphisms. 
However, our Theorem 5.5 is better in the sense that it provides the explicit 
structure of the automorphism group of a free-abelian times free group. 

6 The subgroup fixed by an endomorphism 

In this section we shall study when the subgroup fixed by an endomorphism of 
Z™ X Fn is finitely generated and, in this case, we shall consider the problem 
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of algorithmically computing a basis for it. Wc will consider the following two 
problems. 

Problem 6.1 (Fixed Point Problem, FPPa(G)). Given an automorphism 
of G (by the images of the generators), decide whether F'lx'i! is finitely generated 
and, if so, compute a set of generators for it. 

Problem 6.2 (Fixed Point Problem, FPPe(G)). Given an endomorphism 
of G (by the images of the generators), decide whether Yhi'^ is finitely generated 
and, if so, compute a set of generators for it. 

Of course, the fixed point subgroup of an arbitrary endomorphism of 
is finitely generated, and the problems FPPe(Z™) and FPPa(Z™) are clearly 
solvable, just reducing to solve the corresponding systems of linear equations. 

Again, the case of free groups is much more complicated. Gersten showed 
in [ii] that rk(Fix(/)) < oo for every automorphism (j) 6 kMi{Fn), and Goldstein 
and Turner [12] extended this result to arbitrary endomorphisms of Fn. 

About comput ability, O. Maslakova published [21] in 2003, giving an algo- 
rithm to compute a free basis for Fix0, where 4> s Aut(i^„). After its publication, 
the arguments were found to be incorrect. An attempt to fix them and provide 
a correct solution to FPPa(Fn) has been recently made by O. Bogopolski and O. 
Maslakova in the preprint [ ] not yet published (see the beginning of page 3) ; here, 
the arguments are quite involved and difficult, making strong and deep use of 
the theory of train tracks. It is worth mentioning at this point that, this problem 
was previously solved in some special cases with much simpler arguments and 
algorithms (see, for example Cohen and Lustig for positive automorphisms. 
Turner [25] for special irreducible automorphisms, and Bogopolski [3] for the 
case n = 2). On the other hand, the problem FPPe(Fn) remains still open in 
general. 

When one moves to free-abelian times free groups, the situation is even 
more involved. Similar to what happens with respect to the Howson property, 
FixVP need not be finitely generated for ^' e Aut(Z x F2), and essentially the 
same example from Observation 4.3 can be recycled here: consider the type (I) 
automorphism ^' given hy a 1-^ ta, b 1-^ b, 1 1-^ t; clearly, t^w{a, b) t^^^'^'""w{a, b) 
and so, 

Fix^' = {rw(a,5) I \w\a = 0} = {{t,b)) = {t,a-''ba'' {k e Z)) 

is not finitely generated. 

In the present section we shall analyze how is the fixed point subgroup of an 
endomorphism of a free-abelian times free group, and we shall give an explicit 
characterization on when is it finitely generated. In the case it is, we shall also 
consider the computability of a finite basis for the fixed subgroup, and will solve 
the problems FPPa(Z™ x F„) and FPPe(Z'" x Fn) modulo the corresponding 
problems for free groups, FPPa(-F„) and FPPe(F„). (Our arguments descend 
directly from End(Z™ x Fn) to End(i^„), in such a way that any partial solution 
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to the free problems can be used to give the corresponding partial solution to 
the free-abelian times free problems, see Proposition 6.6 below.) 

Let us distinguish the two types of endomorphisms according to Proposi- 
tion 5.1 (and starting with the easier type (II) ones). 

Proposition 6.3. Let G = Z'" x F„ with n + 1, and consider a type (II) endo- 
morphism namely 

where 1 i= z e Fn is not a proper power, Q € A1„i(Z), P € A^„xm(Z); + 1 6 
Z'", and h e Z" . Then, Fix^^ is finitely generated, and a basis for Fix^ is 
algorithmically computable. 

Proof. First note that Im\l/ is an abelian subgroup of Z™ x Fn. Then, by 
Corollary 1.7, it must be isomorphic to Z™ for a certain m' 4 m + 1. Therefore, 
Fix^ ^ Im(5') is isomorphic to a subgroup of Z™ , and thus finitely generated. 

According to the definition, an element f^u is fixed by ^ if and only if 
^aQ+uP^ai +uh _ ^a^ p^j. ^j^jg Satisfied, u must be a power of z, say u = z"^ 
for certain r € Z, and abelianizing we get u = rz, and the system of equations 

af + rzh^ = r 
a(Im - Q) = rzP 

whose set S of integer solutions (a, r) e Z™^^ describe precisely the subgroup of 
fixed points by \I': 

Fix*= {f'z'^ I (a,r) €5}. 
By solving (6.1), we get the desired basis for Fix^. The proof is complete. □ 

Theorem 6.4. Let G = W^xFn with nt\, and consider a type (I) endomorphism 
namely 

* = *0,Q,p:t'^u^t'^'^+"P u<t>, 

where (j) e End(F„), Q 6 Mmi^), and P e 7W„xm(Z). Let N = Im(Im - Q) n 
ImP', where P' is the restriction of P'-Tj" Z™ to (Fix (j))p, the image of 
Fix (j) ^ Fn under the global abelianization p: Fn Z" . Then, Fix ^ is finitely 
generated if and only if one of the following happens: (i) Fix0 = 1; (ii) Fix0 is 
cyclic, (Fix(/))p t {0}, and NP' ^ = {0}; or (iii) rk(iV) = rk(ImP'). 

Proof. An element f^u is fixed by ^ if and only if t^^^^^ucj) = f^u, i.e. if and 
only if 

u<p = u 
a(Im - Q) = uP 

That is. 

Fix* = {f'u 6 G I -u 6 Fixe/) and a{I^ - Q) = uP}, (6.2) 
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where u = up, and p: Fn Z" is the abehanization map. As we have seen in 
Corollary 1.8, Fix^ is finitely generated if and only if its projection to the free 
part 

(Fix*)7r = Fix0 n {u 6 I uP 6 Ini(I„, - Q)} (6.3) 

is so. Now (identifying integral matrices A with the corresponding linear mapping 
V 1-^ vA, as usual), let M be the image of Im - Q, and consider its preimage first 
by P and then by p, see the following diagram: 

I„-Q 

Fixcj) ^ 

V/ V/ V/ 
MP-^p-^-^ 1 MP-I 1 M=Im(Ir„-Q). 

Equation (6.3) can be rewritten as 

(Fix^')7r = Fix(/i n MP-^p-^. (6.4) 

However, this description does not show whether Fix^I/ is finitely generated 
because Fixcj) is in fact finitely generated, but MP'^p^^ is not in general. We 
shall avoid the intersection with Fixcj) by reducing M to a certain subgroup. Let 
p' be the restriction of p to Fix (j> (not to be confused with the abehanization 
map of the subgroup Fixi^ itself), let P' be the restriction of P to Imp', and let 
N = M n ImP', see the following diagram: 

l„ Q 



F„ Z" Z™ ^ M = Im(I„, - Q) 

V/ , V/ ^ V/ 

Fixcj: '^—^ Imp' — ImP' 

V/ V/ V/ 

NP'^^p'-^-^ 1 A^p'-i ^ 1 7V=MnImP'. 

II 

(Fix*)7r 



Equation (6.4) then rewrites into 

(Fix^')7r = 7VP'"V"^- 

Now, since iVP' ^p'^^ is a normal subgroup of Fixcj> (not, in general, of F„), it 
is finitely generated if and only if it is either trivial, or of finite index in Fix cj>. 

Note that p' is injective (and thus bijective) if and only if Fix0 is either 
trivial, or cyclic not abelianizing to zero (indeed, for this to be the case we cannot 
have two freely independent elements in Fixcj) and so, rk(Fix0) ^ 1). Thus, 
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(Fix4')7r = NP' ^ p' ^ = 1 if and only if Fixcf) is trivial or cyclic not abelianizing 
to zero, and NP'^^ = {0}. 

On the other side, by Lemma 3.2 (ii), iVP' ^p'^^ has finite index in Fix(j) if 
and only if N has finite index in ImP' i.e. if and only if rk(7V) = rk(ImP'). □ 

Example 6.5. Let us analyze again the example given at the beginning of this 
section, under the light of the Theorem 6.4. We considered the automorphism 
\E' of Z X F2 = (i I ) X (a, 6 I ) given hy a 1^ ta, b >-> b and 1 1-^ t, i.e. ^ = ^/2,ii,p, 
where P is the 2x1 matrix P = (1,0)^. It is clear that Fix(/2) = F2 and so, 
conditions (i) and (ii) from Proposition 6.4 do not hold. Furthermore, p' = p, 
P' = P, M = lm(0) = {0}, N = {0}, while ImP' = Z; hence, condition (iii) from 
Theorem 6.4 does not hold either, according to the fact that Fix^f is not finitely 
generated. 

Finally, the proof of Theorem 6.4 is explicit enough to allow us to make 
the whole thing algorithmic: given a type (I) endomorphism 4* = ^0,q,p 6 
End(Z™ X Fn), the decision on whether Fix^P if finitely generated or not, and 
the computation of a basis for it in case it is, can be made effective assuming we 
have a procedure to compute a (free) basis for Fix0: 

Proposition 6.6. Let G = Z™ x F„ with n + 1, and let = ^^.q.p be a type (I) 
endomorphism of G. Assuming a (finite and free) basis for Fix0 is given to us, 
we can algorithmically decide whether Fix ^' is finitely generated or not and, in 
case it is, compute a basis for it. 

Proof. Let {vi, . . . ,Vp} be the (finite and free) basis for Fix0 ^ F„ given to us 
in the hypothesis. 

Theorem 6.4 describes how is Fix 4" and when is it finitely generated. As- 
suming the notation from the proof there, we can compute abelian bases for 

^ ImP' ^ Z™ and A^P'"^ ^ Imp' ^ Z". Then, we can easily check whether 
any of the following three conditions hold: 

(i) Fix (/) is trivial, 

(ii) Fix<?!)= (z), zp + and A^P'"^ = {0}, 

(iii) rk{N) =rk(ImP'). 

If (i), (ii) and (iii) fail then Fix^* is not finitely generated and we are done. Oth- 
erwise, Fix^E* is finitely generated and it remains to compute a basis. From (1.5), 
we have 

Fix*= ((Fix^')nZ") x (Fix^-)™, 

where Fix^* -f-^ (Fix^')7r is any splitting of 7r|pixii,:Fix^' (Fix^')7r. We just 
have to compute a basis for each part and put them together (after algorithmically 
computing some splitting a). Regarding the abelian part, equation (6.2) tells us 
that 

(FixvI/)nZ'" = {t'^|a(U-Q) = 0}, 
and we can easily find an abelian basis for it by just computing ker(Im - Q). 
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Consider now the free part. In cases (i) and (ii), (Fix^')7r = 1 and there is 
nothing to compute. Note that, in these cases, Fix^" is then an abehan subgroup 
of xi^„. 

Assume case (iii), i.e. rk{N) = rk(ImP'). In this situation, N has finite index 
in ImP' and so, iVP' ^ has finite index in Imp'; let us compute a set of coset 
representatives of Imp' modulo iVP' ^, 

Imp' = (iVP'"^)ci u - u (iVP'"^)cq, 

(see Section 3). Now, according to Lemma 3.2 (b), we can transfer this partition 
via p' to obtain a system of right coset representatives of Fix(/() modulo (Fix^')7r = 

Fixcj) = {NP''^p'-^)zi u - u {NP'''^p-^)zq. (6.5) 

To compute the z^'s, note that vi = wip', . . . , Vp = Vpp' generate Imp', write 
each Ci € Imp' as a (non necessarily unique) linear combination of them, say 
Ci = Ci^iVi H 1- Ci^pVp, i 6 [g], and take = v^^'^V2^'^"-Vp^''' e Fixt/). 

Now, construct a free basis for A^P' ^ p'^^ = (Fix4')7r following the first of 
the two alternatives at the end of the proof of Theorem 4.8 (the second one does 
not work here because p' is not the abelianization of the subgroup Fix^, but 
the restriction there of the abelianization of Fn): 

Build the Schreier graph S{NP'^^ p'^^) for iVP'^^p'"^ ^ Fix(/) with respect to 
{vi, . . . ,Vp}, in the following way: consider the graph with the cosets of (6.5) as 
vertices, and with no edge. Then, for every vertex {NP' p'^^)zi and every letter 
Vj, add an edge labeled Vj from (A^P'" p'^^)zi to (A^P'" p'^^)ziVj, algorithmi- 
cally identified among the available vertices by repeatedly using the membership 
problem for A^P' ^p'~^ (note that we can easily do this by abelianizing the 
candidate and checking whether it belongs to A^P' ). Once we have run over all 
we shall get the full graph S{NP' p'"^), from which we can easily obtain 
a free basis for A^P'^V"^ = (Fix*)7r. 

Finally, having a free basis for (Fix^')7r, we can easily construct an splitting 
Fix^f-f-^ (Fix^)7r for 7r|Fix*=Fix^' (Fix^')7r by just computing, for each 
generator u e (Fix^)7r, a preimage e Fix^f, where a e Z™ is a completion 
found by solving the system of equations a(Im - Q) = uP (see (6.2)). 

This completes the proof. □ 

Bringing together Propositions 6.3 and 6.6 and Theorem 6.4, we get the 
following. 

Corollary 6.7. For m^l and 2, 

(i) i/FPPa(F„) IS solvable then FPPa(Z'" x F„) is also solvable. 
(u) i/FPPe(F„) is solvable then FPPe(Z"' x F„) is also solvable. □ 



32 



To close this section, we point the reader to some very recent results related 
to fixed subgroups of endomorphisms of partially commutative groups. In [22], 
E. Rodaro, P.V. Silva and M. Sykiotis characterize which partially commutative 
groups G satisfy that Fix^ is finitely generated for every 4* e End(G) (and, of 
course, free-abelian times free groups are not included there); they also provide 
similar results concerning automorphisms. 

7 The Whitehead problem 

J. Whitehead, back in the 30's of the last century, gave an algorithm [z '< ] to decide, 
given two elements u and v from a finitely generated free group Fm whether 
there exists an automorphism </> e Aut(F„) sending one to the other, v = u4>. 
Whitehead's algorithm uses a (today) very classical piece of combinatorial group 
theory technique called 'peak reduction', see also [18]. Several variations of 
this problem (like replacing u and v by tuples of words, relaxing equality to 
equality up to conjugacy, adding conditions on the conjugators, replacing words 
by subgroups, replacing automorphisms to monomorphisms or endomorphisms, 
etc), as well as extensions of all these problems to other families of groups, can 
be found in the literature, all of them generally known as the Whitehead problem. 
Let us consider here the following ones for an arbitrary finitely generated group G: 

Problem 7.1 (Whitehead Problem, WhPa(G)). Given two elements u, v e 
G, decide whether there exist an automorphism (f> of G such that u<f> = v, and, if 
so, find one (giving the images of the generators). 

Problem 7.2 (Whitehead Problem, WhPm(G)). Given two elements u, v e. 
G, decide whether there exist a monomorphism (p of G such that u(j) = v, and, if 
so, find one (giving the images of the generators). 

Problem 7.3 (Whitehead Problem, WhPe(G)). Given two elements u, v e 
G, decide whether there exist an endomorphism (p of G such that u(j) = v, and, if 
so, find one (giving the images of the generators). 

In this last section we shall solve these three problems for free-abelian times 
free groups. We note that, very recently, a new version of the classical peak- 
reduction theorem has been developed by M. Day [ ] for an arbitrary partially 
commutative group, see also [')]. These techniques allow the author to solve the 
Whitehead problem for partially commutative groups, in its variant relative to 
automorphisms and tuples of conjugacy classes. In particular WhPa(G) (which 
was conjectured in [')]) is solved in [Id] for any partially commutative group 
G. As far as we know, WhPm(G) and WhPe(G) remain unsolved in general. 
Our Theorem 7.6 below is a small contribution into this direction, solving these 
problems for free-abelian times free groups. 

Let us begin by reminding the situation of the Whitehead problems for free- 
abelian and for free groups (the first one is folklore, and the second one is well- 
known). The following lemma is straightforward to prove and, in particular, solves 
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WhPa(Z'"), WhPm(Z'") and WhPeCZ"). Here, for a vector a = (ai, . . . , a™) e 
Z™, we write gcd(a) to denote the greatest common divisor of the a^'s (with the 
convention that gcd(O) = 0). 

Lemma 7.4. // u e Z" and a e Z" \ {0}, then 

(i) {aQ I Q € GL™(Z)} = {a' e Z™ | gcd(a) = gcd(a')}, 

(ii) {aQ I Q 6 A^™(Z) with det(Q) + 0} = {a' e Z™ | gcd(a) | gcd(a')} n {0}, 

(iii) {uP I P 6 A1„„„(Z)} = {u' 6 Z™ I gcd(u) I gcd(u')}. □ 

As expected, the same problems for the free group Fn are much more 
comphcated. As mentioned above, the case of automorphisms was aheady solved 
by Whitehead back in the 30's of last century. The case of endomorphisms 
can be solved by writing a system of equations over Fn (with unknowns being 
the images of a given free basis for Fn), and then solving it by the powerful 
Makanin's algorithm. Finally, the case of monomorphisms was recently solved 
by Ciobanu-Houcine. 

Theorem 7.5. For n^2, 

(i) [Whitehead, [ ]] WhPa(F„) is solvable. 

(ii) [Ciobanu-Houcine, [ ]] WhPm(-F'n) is solvable. 

(ui) [Makanin, [ ]] WhPe(F„) is solvable. □ 
Theorem 7.6. Let rn ^ 1 and 2, then 

(i) WhPa(Z'" X Fn) IS solvable. 

(ii) WhPin(Z" xFn) is solvable. 

(iii) WhPe(Z" xFn) is solvable. 

Proof. We are given two elements t^u, t^v e G = Z™ x F„, and have to decide 
whether there exists an automorphism (resp. monomorphism, endomorphism) of 
G sending one to the other. And in the affirmative case, find one of them. For 
convenience, we shall prove (ii), (i) and (iii) in this order. 

(ii). Since all monomorphisms of G are of type (I), we have to decide whether 
there exist a monomorphism (f> of Fn, and matrices Q e A^„i(Z) and P e 
■Mnx7n{^), with detQ i= 0, such that (t'*u)5'0^Q^p = t^v. Separating the free 
and free-abelian parts, we get two independent problems: 

U(j) = w 1 

\ (7.1) 
aQ + uP = bj ^ ' 

On one hand, we can use Theorem 7.5 (ii) to decide whether there exists a 
monomorphism (j) of Fn such that ucj) = w. If not then our problem has no solution 
either, and we are done; otherwise, WhPm(^ii) gives us such a <j)- 
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On the other hand, we need to know whether there exist matrices Q e A4m{Z) 
and P 6 A^„xm(Z), with det Q and such that aQ + uP = b, where u e Z" is 
the abehanization of w e Fn (given from the beginning). If a = or u = 0, this 
is aheady solved in Lemma 7.4(iii) or (ii). Otherwise, write =^= a = gcd(a) and 
Oi= fi = gcd(u); and, according to Lemma 7.4, we have to decide whether there 
exist a' e and u' e Z™, with a' + 0, a | gcd(a'), and | gcd(u'), such that 
a' + u' = b. Writing a' = ax and u' = /ly, the problem reduces to test whether 
the following linear system of equations 

axi + nyi 

has any integral solution xi, . . . ,Xm,yi, ■■ ■ ^Vm s Z such that (a;i, . . . ,Xm) + 0. 
A necessary and sufficient condition for the system (7.2) to have a solution is 
gcd(a,/x) I hj, for every j e [m]. And note that, if {xi.yi) is a solution to the 
first equation, then {xi + /i,t/i - a) is another one; since /i 0, the condition 
(xi, . . . , Xm) # is then superfluous. Therefore, the answer is affirmative if 
and only if gcd(a,/Lt) | 6j, for every j e [m]; and, in this case, we can easily 
reconstruct a monomorphism of G such that (f^u)*!* = t'°v. 

(i). The argument for automorphisms is completely parallel to the previous 
discussion replacing the conditions (j) monomorphism and det Q + 0, to auto- 
morphism and det Q = ±f. We manage the first change by using Theorem 7.5 (i) 
instead of (ii). The second change forces us to look for solutions to the linear 
system (7.2) with the extra requirement gcd(x) = f (because now gcd(a') should 
be equal and not just multiple of a). 

So, if any of the conditions gcd(Q;,/i) | hj fails, the answer is negative and we 
are done. Otherwise, write p = gcd(Q!,/i), a = pa' and p, = p/i', and the general 
solution for the j-th equation in (7.2) is 

{xj,y.j) = (a;°,y°) + Aj(^',-a'), e Z, 

where (x^,?/°) is a particular solution, which can be easily computed. Thus, it 
only remains to decide whether there exist Ai, . . . , A„i e Z such that 

gcd(2;° + Ai/^', . . . , + XmP) = 1. (7.3) 

We claim that this happens if and only if 

gcd{xl...,xl,,p') = l, (7.4) 

which is clearly a decidable condition. 

Reorganizing a Bezout identity for (7.3) we can obtain a Bezout identity 
for (7.4). Hence (7.3) implies (7.4). For the converse, assume the integers 
x\t . . ,x'^,p' are coprime, and we can fulfill equation (7.3) by taking Ai = ••• = 
Am-i = and A™ equal to the product of the primes dividing xf,. . . , a;°j_i but 
not (take Am = 1 if there is no such prime) . Indeed, let us see that any prime 
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p dividing . . . tX^_i is not a divisor of + Am/i'. If p divides a;^^, then p 
does not divide neither (J nor Am and therefore + Am/x' either. If p does not 
divide a;^, then p divides Am by construction, hence p does not divide Xm + /^mlJ ■ 
This completes the proof of the claim, and of the theorem for automorphisms. 

(iii). In our discussion now, we should take into account endomorphisms of 
both types. 

Again, the argument to decide whether there exists an endomorphism of 
type (I) sending t^u to t^v, is completely parallel to the above proof of (ii), 
replacing the condition cj) monomorphism to </> endomorphism, and deleting the 
condition det Q + (and allowing here an arbitrary matrix Q). We manage the 
first change by using Theorem 7.5 (iii) instead of (ii). The second change simply 
leads us to solve the system (7.2) with no extra condition on the variables; so, 
the answer is affirmative if and only if gcd(a,/i) | 6j, for every j 6 [m]. 

It remains to consider endomorphisms of type (II), ?'z.i,h,Q,p- So, given 
our elements f^u and t^v^ and separating the free and free-abelian parts, we 
have to decide whether there exist z e F„, 1 e Z™, h e Z", Q e A^m(^), and 

P € M.ny.m{'^) SUCh that 



(note that we can ignore the condition 1 + because if 1 = then the endomor- 
phism becomes of type (I) as well, and this case is already considered before). 
Again the two equations are independent. About the free part, note that the inte- 
gers aF + uh^ with 1 6 Z™ and h e Z" are precisely the multiples of c? = gcd(a, u); 
so, it has a solution if and only if w is a d*^ power in a very easy condition to 
check. And about the second equation, it is exactly the same as when considering 
endomorphisms of type (I) , so its solvability is already discussed. □ 
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